PittsburghV1, Main, Exploration, bibRecord, 000059

Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding

Identifieur interne : 000059 ( Main/Exploration ); précédent : 000058; suivant : 000060

Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding

Auteurs : Gunnar Sigurdsson [États-Unis] ; Gül Varol [France] ; Xiaolong Wang [États-Unis] ; Ali Farhadi [États-Unis] ; Ivan Laptev [France] ; Abhinav Gupta [États-Unis]

Source :

RBID : Hal:hal-01418216

Abstract

Computer vision has a great potential to help our daily lives by searching for lost keys, watering flowers or reminding us to take a pill. To succeed with such tasks, computer vision methods need to be trained from real and diverse examples of our daily dynamic scenes. While most of such scenes are not particularly exciting, they typically do not appear on YouTube, in movies or TV broadcasts. So how do we collect sufficiently many diverse but boring samples representing our lives? We propose a novel Hollywood in Homes approach to collect such data. Instead of shooting videos in the lab, we ensure diversity by distributing and crowdsourcing the whole process of video creation from script writing to video recording and annotation. Following this procedure we collect a new dataset, Charades, with hundreds of people recording videos in their own homes, acting out casual everyday activities. The dataset is composed of 9,848 annotated videos with an average length of 30 seconds, showing activities of 267 people from three continents. Each video is annotated by multiple free-text descriptions, action labels, action intervals and classes of interacted objects. In total, Charades provides 27,847 video descriptions, 66,500 temporally localized intervals for 157 action classes and 41,104 labels for 46 object classes. Using this rich data, we evaluate and provide baseline results for several tasks including action recognition and automatic description generation. We believe that the realism, diversity, and casual nature of this dataset will present unique challenges and new opportunities for computer vision community.

Url:

https://hal.inria.fr/hal-01418216

DOI: 10.1007/978-3-319-46448-0_31

Affiliations:

Links toward previous steps (curation, corpus...)

to stream Hal, to step Corpus: 000324
to stream Hal, to step Curation: 000324
to stream Hal, to step Checkpoint: 000058
to stream Main, to step Merge: 000059
to stream Main, to step Curation: 000059

Le document en format XML

<record><TEI><teiHeader><fileDesc><titleStmt><title xml:lang="en">Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding</title>
<author><name sortKey="Sigurdsson, Gunnar" sort="Sigurdsson, Gunnar" uniqKey="Sigurdsson G" first="Gunnar" last="Sigurdsson">Gunnar Sigurdsson</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-87723" status="VALID">          <orgName>Computer Science Department - Carnegie Mellon University</orgName>
          <desc>            <address>              <addrLine>Computer Science Department Carnegie Mellon University Pittsburgh, PA</addrLine>
              <country key="US"></country>
            </address>
            <ref type="url">http://www.cs.cmu.edu/</ref>
          </desc>
          <listRelation>            <relation active="#struct-378064" type="direct"></relation>
          </listRelation>
        <tutelles><tutelle active="#struct-378064" type="direct"><org type="institution" xml:id="struct-378064" status="INCOMING">          <orgName>University of Pittsburgh</orgName>
          <desc>            <address>              <country key="FR"></country>
            </address>
          </desc>
        </org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
<placeName><settlement type="city">Pittsburgh</settlement>
<region type="state">Pennsylvanie</region>
</placeName>
<orgName type="university">Université de Pittsburgh</orgName>
</affiliation>
</author>
<author><name sortKey="Varol, Gul" sort="Varol, Gul" uniqKey="Varol G" first="Gül" last="Varol">Gül Varol</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-454692" status="VALID">  <idno type="RNSR">200718311C</idno>
  <orgName>Models of visual object recognition and scene understanding</orgName>
  <orgName type="acronym">WILLOW</orgName>
  <date type="start">2016-01-01</date>
  <desc>    <address>      <country key="FR"></country>
    </address>
    <ref type="url">http://www.inria.fr/equipes/willow</ref>
  </desc>
  <listRelation>    <relation active="#struct-25027" type="direct"></relation>
    <relation active="#struct-59704" type="indirect"></relation>
    <relation active="#struct-300009" type="indirect"></relation>
    <relation name="UMR8548" active="#struct-441569" type="indirect"></relation>
    <relation active="#struct-454310" type="direct"></relation>
  </listRelation>
<tutelles><tutelle active="#struct-25027" type="direct"><org type="laboratory" xml:id="struct-25027" status="VALID">          <orgName>Département d'informatique de l'École normale supérieure</orgName>
          <orgName type="acronym">DI-ENS</orgName>
          <desc>            <address>              <addrLine>École normale supérieure 45 rue d'Ulm F-75230 Paris Cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.di.ens.fr/</ref>
          </desc>
          <listRelation>            <relation active="#struct-59704" type="direct"></relation>
            <relation active="#struct-300009" type="direct"></relation>
            <relation name="UMR8548" active="#struct-441569" type="direct"></relation>
          </listRelation>
        </org>
</tutelle>
<tutelle active="#struct-59704" type="indirect"><org type="institution" xml:id="struct-59704" status="VALID">          <orgName>École normale supérieure - Paris</orgName>
          <orgName type="acronym">ENS Paris</orgName>
          <desc>            <address>              <addrLine>45, Rue d'Ulm - 75230 Paris cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.ens.fr</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR8548" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID">          <idno type="IdRef">02636817X</idno>
          <idno type="ISNI">0000000122597504</idno>
          <orgName>Centre National de la Recherche Scientifique</orgName>
          <orgName type="acronym">CNRS</orgName>
          <date type="start">1939-10-19</date>
          <desc>            <address>              <country key="FR"></country>
            </address>
            <ref type="url">http://www.cnrs.fr/</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-454310" type="direct"><org type="laboratory" xml:id="struct-454310" status="VALID"><orgName>Inria de Paris</orgName>
<desc><address><addrLine>2 rue Simone Iff -CS 42112 -75589 Paris Cedex 12</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/centre/paris</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author><name sortKey="Wang, Xiaolong" sort="Wang, Xiaolong" uniqKey="Wang X" first="Xiaolong" last="Wang">Xiaolong Wang</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-87723" status="VALID">          <orgName>Computer Science Department - Carnegie Mellon University</orgName>
          <desc>            <address>              <addrLine>Computer Science Department Carnegie Mellon University Pittsburgh, PA</addrLine>
              <country key="US"></country>
            </address>
            <ref type="url">http://www.cs.cmu.edu/</ref>
          </desc>
          <listRelation>            <relation active="#struct-378064" type="direct"></relation>
          </listRelation>
        <tutelles><tutelle active="#struct-378064" type="direct"><org type="institution" xml:id="struct-378064" status="INCOMING">          <orgName>University of Pittsburgh</orgName>
          <desc>            <address>              <country key="FR"></country>
            </address>
          </desc>
        </org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
<placeName><settlement type="city">Pittsburgh</settlement>
<region type="state">Pennsylvanie</region>
</placeName>
<orgName type="university">Université de Pittsburgh</orgName>
</affiliation>
</author>
<author><name sortKey="Farhadi, Ali" sort="Farhadi, Ali" uniqKey="Farhadi A" first="Ali" last="Farhadi">Ali Farhadi</name>
<affiliation wicri:level="1"><hal:affiliation type="institution" xml:id="struct-476519" status="VALID"><orgName>Allen Institute for Artifical Intelligence</orgName>
<orgName type="acronym">AI2</orgName>
<desc><address><country key="US"></country>
</address>
<ref type="url">http://allenai.org/</ref>
</desc>
</hal:affiliation>
<country>États-Unis</country>
</affiliation>
</author>
<author><name sortKey="Laptev, Ivan" sort="Laptev, Ivan" uniqKey="Laptev I" first="Ivan" last="Laptev">Ivan Laptev</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-454692" status="VALID">  <idno type="RNSR">200718311C</idno>
  <orgName>Models of visual object recognition and scene understanding</orgName>
  <orgName type="acronym">WILLOW</orgName>
  <date type="start">2016-01-01</date>
  <desc>    <address>      <country key="FR"></country>
    </address>
    <ref type="url">http://www.inria.fr/equipes/willow</ref>
  </desc>
  <listRelation>    <relation active="#struct-25027" type="direct"></relation>
    <relation active="#struct-59704" type="indirect"></relation>
    <relation active="#struct-300009" type="indirect"></relation>
    <relation name="UMR8548" active="#struct-441569" type="indirect"></relation>
    <relation active="#struct-454310" type="direct"></relation>
  </listRelation>
<tutelles><tutelle active="#struct-25027" type="direct"><org type="laboratory" xml:id="struct-25027" status="VALID">          <orgName>Département d'informatique de l'École normale supérieure</orgName>
          <orgName type="acronym">DI-ENS</orgName>
          <desc>            <address>              <addrLine>École normale supérieure 45 rue d'Ulm F-75230 Paris Cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.di.ens.fr/</ref>
          </desc>
          <listRelation>            <relation active="#struct-59704" type="direct"></relation>
            <relation active="#struct-300009" type="direct"></relation>
            <relation name="UMR8548" active="#struct-441569" type="direct"></relation>
          </listRelation>
        </org>
</tutelle>
<tutelle active="#struct-59704" type="indirect"><org type="institution" xml:id="struct-59704" status="VALID">          <orgName>École normale supérieure - Paris</orgName>
          <orgName type="acronym">ENS Paris</orgName>
          <desc>            <address>              <addrLine>45, Rue d'Ulm - 75230 Paris cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.ens.fr</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR8548" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID">          <idno type="IdRef">02636817X</idno>
          <idno type="ISNI">0000000122597504</idno>
          <orgName>Centre National de la Recherche Scientifique</orgName>
          <orgName type="acronym">CNRS</orgName>
          <date type="start">1939-10-19</date>
          <desc>            <address>              <country key="FR"></country>
            </address>
            <ref type="url">http://www.cnrs.fr/</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-454310" type="direct"><org type="laboratory" xml:id="struct-454310" status="VALID"><orgName>Inria de Paris</orgName>
<desc><address><addrLine>2 rue Simone Iff -CS 42112 -75589 Paris Cedex 12</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/centre/paris</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author><name sortKey="Gupta, Abhinav" sort="Gupta, Abhinav" uniqKey="Gupta A" first="Abhinav" last="Gupta">Abhinav Gupta</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-87723" status="VALID">          <orgName>Computer Science Department - Carnegie Mellon University</orgName>
          <desc>            <address>              <addrLine>Computer Science Department Carnegie Mellon University Pittsburgh, PA</addrLine>
              <country key="US"></country>
            </address>
            <ref type="url">http://www.cs.cmu.edu/</ref>
          </desc>
          <listRelation>            <relation active="#struct-378064" type="direct"></relation>
          </listRelation>
        <tutelles><tutelle active="#struct-378064" type="direct"><org type="institution" xml:id="struct-378064" status="INCOMING">          <orgName>University of Pittsburgh</orgName>
          <desc>            <address>              <country key="FR"></country>
            </address>
          </desc>
        </org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
<placeName><settlement type="city">Pittsburgh</settlement>
<region type="state">Pennsylvanie</region>
</placeName>
<orgName type="university">Université de Pittsburgh</orgName>
</affiliation>
</author>
</titleStmt>
<publicationStmt><idno type="wicri:source">HAL</idno>
<idno type="RBID">Hal:hal-01418216</idno>
<idno type="halId">hal-01418216</idno>
<idno type="halUri">https://hal.inria.fr/hal-01418216</idno>
<idno type="url">https://hal.inria.fr/hal-01418216</idno>
<idno type="doi">10.1007/978-3-319-46448-0_31</idno>
<date when="2016-10-11">2016-10-11</date>
<idno type="wicri:Area/Hal/Corpus">000324</idno>
<idno type="wicri:Area/Hal/Curation">000324</idno>
<idno type="wicri:Area/Hal/Checkpoint">000058</idno>
<idno type="wicri:explorRef" wicri:stream="Hal" wicri:step="Checkpoint">000058</idno>
<idno type="wicri:Area/Main/Merge">000059</idno>
<idno type="wicri:Area/Main/Curation">000059</idno>
<idno type="wicri:Area/Main/Exploration">000059</idno>
</publicationStmt>
<sourceDesc><biblStruct><analytic><title xml:lang="en">Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding</title>
<author><name sortKey="Sigurdsson, Gunnar" sort="Sigurdsson, Gunnar" uniqKey="Sigurdsson G" first="Gunnar" last="Sigurdsson">Gunnar Sigurdsson</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-87723" status="VALID">          <orgName>Computer Science Department - Carnegie Mellon University</orgName>
          <desc>            <address>              <addrLine>Computer Science Department Carnegie Mellon University Pittsburgh, PA</addrLine>
              <country key="US"></country>
            </address>
            <ref type="url">http://www.cs.cmu.edu/</ref>
          </desc>
          <listRelation>            <relation active="#struct-378064" type="direct"></relation>
          </listRelation>
        <tutelles><tutelle active="#struct-378064" type="direct"><org type="institution" xml:id="struct-378064" status="INCOMING">          <orgName>University of Pittsburgh</orgName>
          <desc>            <address>              <country key="FR"></country>
            </address>
          </desc>
        </org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
<placeName><settlement type="city">Pittsburgh</settlement>
<region type="state">Pennsylvanie</region>
</placeName>
<orgName type="university">Université de Pittsburgh</orgName>
</affiliation>
</author>
<author><name sortKey="Varol, Gul" sort="Varol, Gul" uniqKey="Varol G" first="Gül" last="Varol">Gül Varol</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-454692" status="VALID">  <idno type="RNSR">200718311C</idno>
  <orgName>Models of visual object recognition and scene understanding</orgName>
  <orgName type="acronym">WILLOW</orgName>
  <date type="start">2016-01-01</date>
  <desc>    <address>      <country key="FR"></country>
    </address>
    <ref type="url">http://www.inria.fr/equipes/willow</ref>
  </desc>
  <listRelation>    <relation active="#struct-25027" type="direct"></relation>
    <relation active="#struct-59704" type="indirect"></relation>
    <relation active="#struct-300009" type="indirect"></relation>
    <relation name="UMR8548" active="#struct-441569" type="indirect"></relation>
    <relation active="#struct-454310" type="direct"></relation>
  </listRelation>
<tutelles><tutelle active="#struct-25027" type="direct"><org type="laboratory" xml:id="struct-25027" status="VALID">          <orgName>Département d'informatique de l'École normale supérieure</orgName>
          <orgName type="acronym">DI-ENS</orgName>
          <desc>            <address>              <addrLine>École normale supérieure 45 rue d'Ulm F-75230 Paris Cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.di.ens.fr/</ref>
          </desc>
          <listRelation>            <relation active="#struct-59704" type="direct"></relation>
            <relation active="#struct-300009" type="direct"></relation>
            <relation name="UMR8548" active="#struct-441569" type="direct"></relation>
          </listRelation>
        </org>
</tutelle>
<tutelle active="#struct-59704" type="indirect"><org type="institution" xml:id="struct-59704" status="VALID">          <orgName>École normale supérieure - Paris</orgName>
          <orgName type="acronym">ENS Paris</orgName>
          <desc>            <address>              <addrLine>45, Rue d'Ulm - 75230 Paris cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.ens.fr</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR8548" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID">          <idno type="IdRef">02636817X</idno>
          <idno type="ISNI">0000000122597504</idno>
          <orgName>Centre National de la Recherche Scientifique</orgName>
          <orgName type="acronym">CNRS</orgName>
          <date type="start">1939-10-19</date>
          <desc>            <address>              <country key="FR"></country>
            </address>
            <ref type="url">http://www.cnrs.fr/</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-454310" type="direct"><org type="laboratory" xml:id="struct-454310" status="VALID"><orgName>Inria de Paris</orgName>
<desc><address><addrLine>2 rue Simone Iff -CS 42112 -75589 Paris Cedex 12</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/centre/paris</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author><name sortKey="Wang, Xiaolong" sort="Wang, Xiaolong" uniqKey="Wang X" first="Xiaolong" last="Wang">Xiaolong Wang</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-87723" status="VALID">          <orgName>Computer Science Department - Carnegie Mellon University</orgName>
          <desc>            <address>              <addrLine>Computer Science Department Carnegie Mellon University Pittsburgh, PA</addrLine>
              <country key="US"></country>
            </address>
            <ref type="url">http://www.cs.cmu.edu/</ref>
          </desc>
          <listRelation>            <relation active="#struct-378064" type="direct"></relation>
          </listRelation>
        <tutelles><tutelle active="#struct-378064" type="direct"><org type="institution" xml:id="struct-378064" status="INCOMING">          <orgName>University of Pittsburgh</orgName>
          <desc>            <address>              <country key="FR"></country>
            </address>
          </desc>
        </org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
<placeName><settlement type="city">Pittsburgh</settlement>
<region type="state">Pennsylvanie</region>
</placeName>
<orgName type="university">Université de Pittsburgh</orgName>
</affiliation>
</author>
<author><name sortKey="Farhadi, Ali" sort="Farhadi, Ali" uniqKey="Farhadi A" first="Ali" last="Farhadi">Ali Farhadi</name>
<affiliation wicri:level="1"><hal:affiliation type="institution" xml:id="struct-476519" status="VALID"><orgName>Allen Institute for Artifical Intelligence</orgName>
<orgName type="acronym">AI2</orgName>
<desc><address><country key="US"></country>
</address>
<ref type="url">http://allenai.org/</ref>
</desc>
</hal:affiliation>
<country>États-Unis</country>
</affiliation>
</author>
<author><name sortKey="Laptev, Ivan" sort="Laptev, Ivan" uniqKey="Laptev I" first="Ivan" last="Laptev">Ivan Laptev</name>
<affiliation wicri:level="1"><hal:affiliation type="researchteam" xml:id="struct-454692" status="VALID">  <idno type="RNSR">200718311C</idno>
  <orgName>Models of visual object recognition and scene understanding</orgName>
  <orgName type="acronym">WILLOW</orgName>
  <date type="start">2016-01-01</date>
  <desc>    <address>      <country key="FR"></country>
    </address>
    <ref type="url">http://www.inria.fr/equipes/willow</ref>
  </desc>
  <listRelation>    <relation active="#struct-25027" type="direct"></relation>
    <relation active="#struct-59704" type="indirect"></relation>
    <relation active="#struct-300009" type="indirect"></relation>
    <relation name="UMR8548" active="#struct-441569" type="indirect"></relation>
    <relation active="#struct-454310" type="direct"></relation>
  </listRelation>
<tutelles><tutelle active="#struct-25027" type="direct"><org type="laboratory" xml:id="struct-25027" status="VALID">          <orgName>Département d'informatique de l'École normale supérieure</orgName>
          <orgName type="acronym">DI-ENS</orgName>
          <desc>            <address>              <addrLine>École normale supérieure 45 rue d'Ulm F-75230 Paris Cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.di.ens.fr/</ref>
          </desc>
          <listRelation>            <relation active="#struct-59704" type="direct"></relation>
            <relation active="#struct-300009" type="direct"></relation>
            <relation name="UMR8548" active="#struct-441569" type="direct"></relation>
          </listRelation>
        </org>
</tutelle>
<tutelle active="#struct-59704" type="indirect"><org type="institution" xml:id="struct-59704" status="VALID">          <orgName>École normale supérieure - Paris</orgName>
          <orgName type="acronym">ENS Paris</orgName>
          <desc>            <address>              <addrLine>45, Rue d'Ulm - 75230 Paris cedex 05</addrLine>
              <country key="FR"></country>
            </address>
            <ref type="url">http://www.ens.fr</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-300009" type="indirect"><org type="institution" xml:id="struct-300009" status="VALID"><orgName>Institut National de Recherche en Informatique et en Automatique</orgName>
<orgName type="acronym">Inria</orgName>
<desc><address><addrLine>Domaine de VoluceauRocquencourt - BP 10578153 Le Chesnay Cedex</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/en/</ref>
</desc>
</org>
</tutelle>
<tutelle name="UMR8548" active="#struct-441569" type="indirect"><org type="institution" xml:id="struct-441569" status="VALID">          <idno type="IdRef">02636817X</idno>
          <idno type="ISNI">0000000122597504</idno>
          <orgName>Centre National de la Recherche Scientifique</orgName>
          <orgName type="acronym">CNRS</orgName>
          <date type="start">1939-10-19</date>
          <desc>            <address>              <country key="FR"></country>
            </address>
            <ref type="url">http://www.cnrs.fr/</ref>
          </desc>
        </org>
</tutelle>
<tutelle active="#struct-454310" type="direct"><org type="laboratory" xml:id="struct-454310" status="VALID"><orgName>Inria de Paris</orgName>
<desc><address><addrLine>2 rue Simone Iff -CS 42112 -75589 Paris Cedex 12</addrLine>
<country key="FR"></country>
</address>
<ref type="url">http://www.inria.fr/centre/paris</ref>
</desc>
<listRelation><relation active="#struct-300009" type="direct"></relation>
</listRelation>
</org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>France</country>
</affiliation>
</author>
<author><name sortKey="Gupta, Abhinav" sort="Gupta, Abhinav" uniqKey="Gupta A" first="Abhinav" last="Gupta">Abhinav Gupta</name>
<affiliation wicri:level="1"><hal:affiliation type="laboratory" xml:id="struct-87723" status="VALID">          <orgName>Computer Science Department - Carnegie Mellon University</orgName>
          <desc>            <address>              <addrLine>Computer Science Department Carnegie Mellon University Pittsburgh, PA</addrLine>
              <country key="US"></country>
            </address>
            <ref type="url">http://www.cs.cmu.edu/</ref>
          </desc>
          <listRelation>            <relation active="#struct-378064" type="direct"></relation>
          </listRelation>
        <tutelles><tutelle active="#struct-378064" type="direct"><org type="institution" xml:id="struct-378064" status="INCOMING">          <orgName>University of Pittsburgh</orgName>
          <desc>            <address>              <country key="FR"></country>
            </address>
          </desc>
        </org>
</tutelle>
</tutelles>
</hal:affiliation>
<country>États-Unis</country>
<placeName><settlement type="city">Pittsburgh</settlement>
<region type="state">Pennsylvanie</region>
</placeName>
<orgName type="university">Université de Pittsburgh</orgName>
</affiliation>
</author>
</analytic>
<idno type="DOI">10.1007/978-3-319-46448-0_31</idno>
</biblStruct>
</sourceDesc>
</fileDesc>
<profileDesc><textClass></textClass>
</profileDesc>
</teiHeader>
<front><div type="abstract" xml:lang="en">Computer vision has a great potential to help our daily lives by searching for lost keys, watering flowers or reminding us to take a pill. To succeed with such tasks, computer vision methods need to be trained from real and diverse examples of our daily dynamic scenes. While most of such scenes are not particularly exciting, they typically do not appear on YouTube, in movies or TV broadcasts. So how do we collect sufficiently many diverse but boring samples representing our lives? We propose a novel Hollywood in Homes approach to collect such data. Instead of shooting videos in the lab, we ensure diversity by distributing and crowdsourcing the whole process of video creation from script writing to video recording and annotation. Following this procedure we collect a new dataset, Charades, with hundreds of people recording videos in their own homes, acting out casual everyday activities. The dataset is composed of 9,848 annotated videos with an average length of 30 seconds, showing activities of 267 people from three continents. Each video is annotated by multiple free-text descriptions, action labels, action intervals and classes of interacted objects. In total, Charades provides 27,847 video descriptions, 66,500 temporally localized intervals for 157 action classes and 41,104 labels for 46 object classes. Using this rich data, we evaluate and provide baseline results for several tasks including action recognition and automatic description generation. We believe that the realism, diversity, and casual nature of this dataset will present unique challenges and new opportunities for computer vision community.</div>
</front>
</TEI>
<affiliations><list><country><li>France</li>
<li>États-Unis</li>
</country>
<region><li>Pennsylvanie</li>
</region>
<settlement><li>Pittsburgh</li>
</settlement>
<orgName><li>Université de Pittsburgh</li>
</orgName>
</list>
<tree><country name="États-Unis"><region name="Pennsylvanie"><name sortKey="Sigurdsson, Gunnar" sort="Sigurdsson, Gunnar" uniqKey="Sigurdsson G" first="Gunnar" last="Sigurdsson">Gunnar Sigurdsson</name>
</region>
<name sortKey="Farhadi, Ali" sort="Farhadi, Ali" uniqKey="Farhadi A" first="Ali" last="Farhadi">Ali Farhadi</name>
<name sortKey="Gupta, Abhinav" sort="Gupta, Abhinav" uniqKey="Gupta A" first="Abhinav" last="Gupta">Abhinav Gupta</name>
<name sortKey="Wang, Xiaolong" sort="Wang, Xiaolong" uniqKey="Wang X" first="Xiaolong" last="Wang">Xiaolong Wang</name>
</country>
<country name="France"><noRegion><name sortKey="Varol, Gul" sort="Varol, Gul" uniqKey="Varol G" first="Gül" last="Varol">Gül Varol</name>
</noRegion>
<name sortKey="Laptev, Ivan" sort="Laptev, Ivan" uniqKey="Laptev I" first="Ivan" last="Laptev">Ivan Laptev</name>
</country>
</tree>
</affiliations>
</record>

Pour manipuler ce document sous Unix (Dilib)

EXPLOR_STEP=$WICRI_ROOT/Wicri/Amérique/explor/PittsburghV1/Data/Main/Exploration

HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000059 | SxmlIndent | more

HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000059 | SxmlIndent | more

Pour mettre un lien sur cette page dans le réseau Wicri

{{Explor lien
   |wiki=    Wicri/Amérique
   |area=    PittsburghV1
   |flux=    Main
   |étape=   Exploration
   |type=    RBID
   |clé=     Hal:hal-01418216
   |texte=   Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding
}}

This area was generated with Dilib version V0.6.38.
Data generation: Fri Jun 18 17:37:45 2021. Site generation: Fri Jun 18 18:15:47 2021

	Serveur d'exploration sur Pittsburgh
	Attention, ce site est en cours de développement ! Attention, site généré par des moyens informatiques à partir de corpus bruts. Les informations ne sont donc pas validées.

Serveur d'exploration sur Pittsburgh

Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding

Hollywood in Homes: Crowdsourcing Data Collection for Activity Understanding

Source :

Abstract

Links toward previous steps (curation, corpus...)

Le document en format XML

Pour manipuler ce document sous Unix (Dilib)

Pour mettre un lien sur cette page dans le réseau Wicri